Quantum inspired algorithms for learning and control of stochastic systems

Motivated by the limitations of the current reinforcement learning and optimal control techniques, this dissertation proposes quantum theory inspired algorithms for learning and control of both single-agent and multi-agent stochastic systems. A common problem encountered in traditional reinforcement learning techniques is the exploration-exploitation trade-off. To address the above issue an action selection procedure inspired by a quantum search algorithm called Grover\u27s iteration is developed. This procedure does not require an explicit design parameter to specify the relative frequency of explorative/exploitative actions. The second part of this dissertation extends the powerful adaptive critic design methodology to solve finite horizon stochastic optimal control problems. To numerically solve the stochastic Hamilton Jacobi Bellman equation, which characterizes the optimal expected cost function, large number of trajectory samples are required. The proposed methodology overcomes the above difficulty by using the path integral control formulation to adaptively sample trajectories of importance. The third part of this dissertation presents two quantum inspired coordination models to dynamically assign targets to agents operating in a stochastic environment. The first approach uses a quantum decision theory model that explains irrational action choices in human decision making. The second approach uses a quantum game theory model that exploits the quantum mechanical phenomena \u27entanglement\u27 to increase individual pay-off in multi-player games. The efficiency and scalability of the proposed coordination models are demonstrated through simulations of a large scale multi-agent system --Abstract, page iii

New hyperchaotic system with single nonlinearity, its electronic circuit and encryption design based on current conveyor

Nowadays, hyperchaotic system (HCSs) have been started to be used in engineering applications because they have complex dynamics, randomness, and high sensitivity. For this purpose, HCSs with different features have been introduced in the literature. In this work, a new HCS with a single discontinuous nonlinearity is introduced and analyzed. The proposed system has one saddle focus equilibrium. When the dynamic properties and bifurcation graphics of the system are analyzed, it is determined that the proposed system exhibits the complex phenomenon of multistability. Moreover, analog electronic circuit design of the proposed system is performed with positive second-generation current conveyor. In addition, an encryption circuit is designed to demonstrate that the proposed system can be used in various engineering applications

A chaotic jerk system with different types of equilibria and its application in communication system

In this paper, a new jerk system is designed. This system can display different characters of equilibrium points according to the value of its parameters. The proposed nonlinear oscillator can have both self-excited and hidden attractors. Dynamical properties of this system are investigated with the help of eigenvalues of equilibria, Lyapunov exponents' spectrum, and bifurcation diagrams. Also, an electronic circuit implementation is carried out to show the feasibility of this system. As an engineering application of this new chaotic jerk system, a chaotic communication system is realized by correlation delay shift keying. When the results of the communication system are examined, the transmitted information signal is successfully obtained in the receiving unit, and its performance efficiency is investigated in the presence of additive white Gaussian noise

ASSESSMENT OF POTENTIAL DRUG INTERACTIONS AMONG HOSPITALIZED PATIENTS AT THE CARDIAC AND PULMONARY DEPARTMENTS IN TERTIARY CARE HOSPITALS

Objective: The aim of this study was to assess the potential drug interactions among hospitalized patients in cardiac and pulmonary wards in three tertiary care hospitals.Methods: A prospective, observational study was carried out for 12 months. A sample of 1150 patients were assessed for potential drug-drug interactions (pDDIs) using Micromedex®- 2.7 and Drugs.com.Results: A total of 1150 patients were analyzed, and it was found that 685 were cardiac and 465 were pulmonary patients. The study identified 524 (76.49%) cardiac patients and 345 (74.19%) pulmonary patients, with pDDIs higher in male cardiac (298 [56.87%]) and male pulmonary (199 [57.68%]) patients, compared to females. Incidences of pDDIs were found to be higher in the age group of 60–70 years in cardiac (193 [36.83%]) and pulmonary (146 [42.31%]) patients and incidences of interactions based on duration of 4–6 days' hospital stays in cardiac were 380 (72.53%) and 215 (62.31%) in pulmonary patients, respectively. Moreover, 51.90% of cardiac patients and 56.52% of pulmonary patients were found to be prescribed with more number of drugs (cardiac 7 drugs and pulmonary 5–6 drugs) causing higher incidences of pDDIs. Some of the most common drug interacting pair was aspirin and clopidogrel combination observed in 245 cardiac patients, whereas in the pulmonary department, it was ranitidine-theophylline combination with a frequency of 195 pDDIs. Drug-food interactions were found with atorvastatin–citrus fruits in cardiac and theophylline–caffeine in pulmonary patients. The most common drug-disease interaction was found to be isosorbide dinitrate–myocardial infarction in cardiac and diazepam–COPD in pulmonary, respectively.Conclusion: Pharmacists must take responsibility in the monitoring of drug interactions and notifying the physician and patient about potential problems. With their detailed knowledge of drugs, pharmacists have the ability to relate unexpected symptoms experienced by patients to possible adverse effects of their drug therapy

PHARMACIST INTERVENTION ON IDENTIFICATION OF DRUG INTERACTIONS IN TERTIARY CARE HOSPITALS

Objective: The aim of this study was to assess the potential drug interactions (pDIs) among hospitalized patients in cardiac and neurology wards in 3 tertiary care hospitals.Methods: A prospective, observational study was carried out for a period of 12 mo. A sample of 1330 patients was assessed for pDDIs using Micromedex®-2.7and drugs.com and www.dugs.com.Results: A total of 1330 patients were analyzed and it was found that 685 were cardiac and 645 were neurology patients. The study identified 524 (76.49%) cardiac patients and 425 (65.89%) neurology patients, with potential drug-drug interactions (pDDIs) higher in male cardiac [298 (56.87%)] and male neurology [235 (55.29%)] patients, compared to females. Incidences of pDDIs were found to be higher in the age group of 60-70 y in cardiac [193 (36.83%)] and neurology [165 (38.84%)] patients and incidences of interactions based on duration of (4-6 d) hospital stays in cardiac were 380 (72.53%) and 275 (64.70%) in neurology patients respectively. Moreover, 51.90% cardiac patients and 57.41% neurology patients were found to be prescribed with more number of drugs in cardiac and neurology (7 drugs) patients, were found to have developed higher incidences of pDDIs. The most common drug interacting pair was between aspirin and clopidogrel combination, observed in 245 cardiac and 316 in neurology patients. Drug-food interactions (DFIs) were found with between atorvastatin-citrus fruits in cardiac and phenytoin-protein rich foods in neurology patients. The most common drug-disease interaction (D-DIs) was found to between isosorbide dinitrate–myocardial infarction in cardiac and carbamazepine-seizuresin neurology respectively.Conclusion: It is recommended that physicians should be aware of the interactions among those drugs while prescribing, and careful monitoring is also required

Does pamidronate enhance the osteogenesis in mesenchymal stem cells derived from fibrous hamartoma in congenital pseudarthrosis of the tibia?

AbstractNeurofibromatosis type 1 (NF1) is a commonly occurring genetic disorder in children. Mutation in the NF1 gene has its implication in poor osteoblastic capabilities. We hypothesised that pamidronate will enhance the osteoblastic potential of the mesenchymal stem cells (MSCs) derived from lipofibromatosis tissue of children with congenital pseudarthrosis tibia (CPT) associated with NF1. In this study, bone marrow MSCs (BM MSCs) and CPT MSCs were obtained from three patients undergoing salvage surgeries/bone grafting (healthy controls) and those undergoing excision of the hamartoma and corrective surgeries respectively. The effects of pamidronate (0, 10nM, 100nM and 1μM) on cell proliferation, toxicity and differentiation potential were assessed and the outcome was measured by staining and gene expression. Our outcome showed that CPT MSCs had more proliferation rate as compared to BM MSCs. All 3 doses of pamidronate did not cause any toxicity to the cells in both the groups. The CPT MSCs showed less differentiation with pamidronate compared to the healthy control MSCs. This was quantitated by staining and gene expression analysis. Therefore, supplementation with pamidronate alone will not aid in bone formation in patients diagnosed with CPT. An additional stimulus is required to enhance bone formation

Fractional-Order Analysis of Modified Chua’s Circuit System with the Smooth Degree of 3 and Its Microcontroller-Based Implementation with Analog Circuit Design

In the paper, we futher consider a fractional-order system from a modified Chua’s circuit system with the smooth degree of 3 proposed by Fu et al. Bifurcation analysis, multistability and coexisting attractors in the the fractional-order modified Chua’s circuit are studied. In addition, microcontroller-based circuit was implemented in real digital engineering applications by using the fractional-order Chua’s circuit with the piecewise-smooth continuous system